(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europden des brevets 



(12) 



EP 1 195139 A1 

EUROPEAN PATENT APPLICATION 



(43) Date of publication: 

10.04.2002 Bulletin 2002/15 

(21) Application number: 00810920.9 

(22) Date of filing: 05.10.2000 



(51) mtci J: A61B 5/11, A63B 23/02, 
G08B 21/00 



(84) Designated Contracting States: 


(72) Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• Najafi, Bijan 


MC NL PT SE 


1007 Lausanne (CH) 


Designated Extension States: 


• Aminian, Kamiar 


AL LT LV MK RO SI 


1030 Bussigny (CH) 


(71) Applicant: ECOLE POLYTECHNIQUE FEDERALE 


(74) Representative: Besse, Francois 


DE LAUSANNE (EPFL) 


Andre Roland Intellectual Property Services 


1015 Lausanne (CH) 


15, avenue Tissot 




Case Postale 1255 




1001 Lausanne (CH) 



(54) Body movement monitoring system and method 



(57) The present invention relates to a system and 
a method for monitoring body movement, in particular 
but not exclusively for evaluating the falling risk and/or 



for monitoring walking or running periods. 

The system is characterized by the fact that it com- 
prises means for determining the time of postural tran- 
sition. 
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Description 

[0001] The present invention relates to a system and a method for monitoring body movement, in particular but not 
exclusively for evaluating the falling risk and/or for monitoring walking or running periods. 

5 [0002] Falls are certainly the most common type of home accidents among elderly people and are a major threat to 
their health and independence. Studies have shown that in a sample of community-dwelling persons of 75 years and 
older, 32 % fall at least once a year. Among them, 24% sustain serious injuries. In addition, falling can dramatically 
change an elderly person's self-confidence and motivation, affecting his ability to function independently. Considering 
the growing part of very old people in the population of industrial countries (more than 47% of the elderly will be aged 

10 over 75 in 2006), falls will be one of the major problems of this important part of population. 

[0003] Evaluating the risk of falling is important because it allows better providing adapted assistance and preventive 
measures to the concerned subjects. The risk of falling is generally evaluated by using a questionnaire that deals with 
problems of subjectivity and limited accuracy in recall or by clinical and functional assessment including posture and 
gait, independence in daily life, cognition and vision. 

15 [0004] Nyberg and Gustafson ("Patients falls in stroke rehabilitation. A challenge to rehabilitation strategies Stroke, 
vol.26, pp. 832-842, 1995) reported that many fails in stroke patients occur during activities in which they change 
position (e.g. standing up, sitting down, or initiating walking). Although there are some studies about the relation of 
postural transition duration with the risk of falls, the methods of investigation used have serious limitation since they 
consist in performing tests under the constraint of laboratory and instruments such as force-platform. 

20 [0005] Quantifying daily physical activity is a determining factor for evaluating the quality of life of subjects with limited 
mobility, e.g. in old age. Operative procedures and pathology, such as joints dysfunction and cardiovascular impairment, 
limit the patient's mobility and physical activity. A reliable measurement of the physical activity in everyday life would 
allow a better assessment of the utility and the relevance of a number of medical treatments. Continuous 24-h record- 
ings of posture and motion can be generally useful in behavior assessment. The nature of postural transitions between 

25 standing, sitting and lying allow to categorize the type of activity and also to better understand problems occurring 
during daily activity (difficulty during rising from a chair, falling, etc). The ability to sit and to stand may also be regarded 
as a physiologically essential function in human beings and a prerequisite for gait. In the past, the ambulatory meas- 
urement of physical activity often relied on the use of an accelerometer strapped on the waist, the wrist, or the ankle 
(see e.g. Patterson S.M., Krantz D.S., Montgomery L.C., Deuster P.A., Hedges S.M. and Nebel L.E., "Automated 

30 physical activity monitoring : validation and comparison with physiological and self- report measures", Psychophisiol- 
ogy, Vol. 30, pp. 296-305, 1993. NG A.V. and Kent-Braun J.A., "Quantitation of lower physicalactivity in persons with 
multiple sclerosis", Med. Sci. Sports Exerc, Vol. 29, pp. 517-523, 1997), but these methods provide no information on 
the type of activity. Recently new systems have been developed to identify the type of activity (K. Aminian, Ph. Robert, 
E.E. Buchser, " Physical activity monitoring based on accelerometry: validation and comparison with video observa- 

35 tion", Medical & Bio. Eng. & comp, vol. 37, pp. 1-5, March 1999), but these methods are based on two different sites 
of attachment and due to discomfort caused by sensors and cable fixation, in certain cases, are not easy to use during 
long term monitoring of physical activity. 

[0006] The above cited problems are overcomed in the present invention which concerns a body movement moni- 
toring system comprising : 

40 

a sensor to be attached to the trunk of a subject, 
processing means for deriving information from said sensor, 
display means for displaying said information to an operator, 

45 wherein said system includes means for determining the time of postural transition. 
[0007] Preferably the sensor comprises a miniature gyroscope. 

[0008] In the present text, the expression "postural transition" is defined as the movement performed during a sit- 
stand or a stand-sit transition (e.g. rise up from the chair, sit down the chair). 

[0009] In an embodiment of the invention, the system also includes means to determine the duration of postural 
50 transition. As shown hereafter such a configuration allows the estimation of falling risk from ambulatory monitoring and 
during the daily life in elderly subjects. This results in an improvement in their life quality. 

[001 0] In another embodiment of the invention, the system also comprises a vertical accelerometer. As shown further 
in the text this additional element allows the monitoring of a complete physical activity, namely the detection of body 
postures such as sitting, standing and lying together with walking or running state. It should be pointed out that all 
55 these detections are carried out by a single sensor attached to the trunk (preferably on the chest). 

[0011] In another embodiment of the invention, the system also comprises alarm means which are activated when 
the quality of postural transition is behind a threshold. The quality of postural transition is assessed using three pa- 
rameters, namely the average and standard deviation of postural transition duration and the occurrence of abnormal 
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successive transitions. 

[0012] The invention will now be described by way of examples using the following figures : 

Figure 1 illustrates postural transitions 

Figure 2 illustrates a basis function used for a wavelet analysis 

Figure 3 shows a flow chart of the algorithm used in example A 

Figure 4 represents a first view of the results of example A 
Figure 5 represents another view of the results of example A 

Figure 6 shows a comparison for different postural transitions with a reference system 

Figure 7 illustrates a situation where several postural transitions occur immediately one after the other 

Figure 8 represents the sensors attachment in examples A and B 

Figure 9 shows a vertical displacement (a) and the corresponding acceleration (b for sit-stand and c for stand-sit) 
in example B 

Figure 10 illustrates the wavelet algorithm used with example A and B 

Figure 1 1 shows the efficiency of the wavelet analysis 

Figure 1 2 shows differently the efficiency of the wavelet analysis 

Figure 13 shows a comparison between our sensor (Gyroscope) and a reference system (Vicon™). 
Figure 14 shows the efficiency of the wavelet analysis for walking sequence enhancement. 
Figure 15 shows a physical activity classification 
Figure 16 shows a first trunk tilt estimation 
Figure 17 shows another trunk tilt estimation 
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Example A : Falling risk evaluation in elderly 
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A. Experimental design 

[0013] Eleven subjects older than 65 were studied. Written informed consent was obtained from all the subjects, and 
the ethical committee of the University of Geneva approved the protocol. A medical history was obtained including 
medication use and history of falls during the preceding year. A standardized mobility assessment testing static equi- 
librium and gait was performed according to Tinetti (ME Tinetti, TF. Williams, R. Mayewski," Fall risk index for elderly 
patients based on number of chronic disabilities," Am. J. Med., vol. 80, pp. 429-434, 1 986). A fall risk score was obtained 
by addition of subscores of known risk factors for falls, shown in table 1 . 

[0014] The final score was normalized between 0 (lowest risk) and 10 (highest risk). Subjects were divided into two 
groups: fallers and non-fallers. If a patient had fall risk score higher or equal to '5\ he was classified as faller and else 
non-faller. 

[0015] Each subject performed different activities involving postural transitions (such as Stand-Sit: SiSt, Sit-Stand: 
StSi) and dynamic activities (walking) with use of different type of chairs (standard wood chair, armchair and upholster 
chair) with and without use of armrest. The protocol of the measurement is presented in table 1. For each test, the 
subjects were asked to sit down and stand up three times. 

TABLE 1 



FALL RISK SCORE 


Parameters 


Score 


History of falls in the preceding year 


No = 0/ Yes =2 


Static equilibrium disturbances 


No =0 / Discrete =1 / Marked =2 


Gait disturbances 


No =0 / Discrete =1 / Marked =2 


Troubles of vision 


No =0 / Discrete =1 / Marked =2 


Troubles of cognition 


No =0 / Discrete =1 / Marked =2 


Troubles of mood 


No =0 / Discrete =1 / Marked =2 
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TABLE 2 



DIFFERENT TESTS PERFORMED BY EACH SUBJECT . 


Test 


Type of Activity 


Type of Seat 


1 


Sit to Stand + walking + Stand to Sit 


Upholster without armrest 
(Seat Height: 48 cm) 


2 


Sit to Stand + Stand to Sit 


Armchair with armrest 
(Seat Height: 46 cm) 


3 


Sit to Stand + Stand to Sit 


Wooden chair without armrest 
(Seat Height: 46 cm) 


4 


Sit to Stand + Stand to Sit 


Upholster chair without armrest 
(Seat Height: 48 cm) 


5 


Sit to Stand + Stand to Sit 


Wooden Chair with armrest 
; (Seat Height: 46 cm) 



B. Portable measuring device 

20 

[0016] Trunk tilt needs to be recorded for the successful identification of body posture transition. This trunk tilt cor- 
responds to the angle '9* between the vertical axis and the subject's anterior wall of his thorax. In order to estimate 9 
a piezoelectric gyroscope (Murata, ENC-03J, ±400 deg/sec) was attached with a belt in front of the sternum. The 
angular rate signal was amplified, low-pass filtered (17 Hz), digitized (12 bit) at a sampling rate of 40 Hz by a portable 
25 data logger (Physilog, BioAGM, CH) and stored on a memory card. At the end of the recording the data were transferred 
to the computer for analysis. 

C. Reference method 

30 [0017] A standard motion analysis system (Vicon™, Oxford Metrics, UK), was used as reference. Five infrared cam- 
eras arranged around the subject and four retro reflective markers placed one on the left acromion, one on the sternum 
manubrium and 2 on the belt holding the kinematic sensor, on each side of it. These markers have allowed an accurate 
3D measurement of the chest movement. Trunk tilt and displacement of the gyroscope were calculated from the 3D 
components of the markers. The sample frequency of the recording was 50 Hz. 

35 

D. Postural transition estimation 

[0018] Fig. 1 shows that during both SiSt and StSi transition, there is first a leaning forward followed by a leaning 
backward. In order to estimate the time of postural transition: PT, first the trunk tilt, '9', was calculated by integrating 
to the angular rate signal measured by the gyroscope. Then the sin(9) was calculated and its minimum peak was con- 
sidered as PT. The postural transition duration: TD, was calculated by estimating the interval time between the beginning 
of leaning forward and the end of the leaning backward. The estimation consisted to detect the maximum peaks before 
and after PT. Considering these two peaks respectively by P^ and P 2 , and their corresponding time by t(Pj) and t(P 2 ), 
TD was estimated as follow: 

45 

TD^fPzHP,) 

E. Wavelet Analysis 

so 

[0019] One of the drawbacks of integration from piezoelectric gyroscope is the presence of drift in the measured 
signal. In order to cancel this drift and to prevent other noises such as movement artifacts, which do not relate to 
posture transitions, discrete wavelet transform (DWT) based on Mallat algorithm was used as filtering method. This 
new tool differs from the traditional Fourier techniques by the way in which they localize the information in the time- 
55 frequency plane. In particular, it allows trading one type of resolution for the other, which makes them especially suitable 
for the analysis of nonstationary signals such as human motion signals. In this method, it is possible to analyze the 
signal in both of the time and frequency domains. This is an important aspect to detect the desired band frequency 
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related to body posture transition. In other words, the important aspect of trunk tilt signals is that the information of 
interest is often a combination of features that are well localized in time and frequency domains. This requires the use 
of analysis methods sufficiently versatile to handle events that can be at opposite extremes in terms of their time- 
frequency localization. Moreover, this method allows using a suitable basic function, which is more similar to the pattern 
trunk tilt during transition. An example of a basic function is given in fig. 2 for various dilation factors. Each of these 
functions has similar basic shapes and cyclic variations. 

[0020] A multi-resolution transform is used to approximate the signal with different resolutions. It consists to split a 
signal into high-scale (low-frequency components) called approximation and low-scale (high-frequency components) 
called the detail. The decomposition is iterated, with successive approximations (or details) being decomposed in turn, 
so the original signal is broken down into many lower-resolution components. At each decompositions scale the number 
of samples in the time domain is decreased by throwing away every second sample (down sampling with a factor of 
'2'). By considering the original signal s(n) (i.e. sinus of trunk tilt), the approximation of the signal at scale j=0 is A 20 S 
which corresponds to the original signal s(n). At each new decomposition the approximation and detail loss in resolution 
since at each scale 2 samples will be replaced by one. At scale j the AjS represents approximation of s(n) with a 
resolution of one sample for every 2i samples of the original signal. 

[0021] Mallat showed that using a suitable low-pass filter h, and a high-pass filter g, the approximate signal A^S 
and detail signal S can be further written as following: 



20 

+00 

25 

+00 

30 [0022] The coefficients of h and g filter are associated with the shape of wavelet considered for the analysis. In this 
study, decomposition into 10 scales with the 'Cubic B-spline' [9] wavelets has been used. 

[0023] In addition these wavelets can be implemented very efficiently using standard decimated (or non-decimated) 
filter-bank algorithms. 

35 E Algorithm 

[0024] A flowchart of our algorithm is summarized in fig. 3. First, signal of gyroscope was segmented to one-minute 
duration packs. Then the signal was integrated and sin(9) was calculated. In order to cancel the drift of integration and 
movement artifacts, wavelet analysis was applied. For each postural transition, the approximation corresponding to 
40 (A 2 kS'A 2t S) was chosen. The values of k and I correspond to scales, which provide the best approximation of StSi and 
SiSt transitions. PT and TD were estimated from sin(6) as described earlier. In the end of each test the mean of TD 
(M_TD) and its standard deviation (A_TD) were calculated. 

[0025] In order to test the significance of the TD for the evaluation of risk of falling, T-test was used between the 
parameters obtained for faller and non-faller groups. 

45 

RESULTS 

[0026] Fig. 4 shows the time-scale contour-plot of sin(G) obtained from the gyroscope compared to that measured 
with Vicon. The result shows that the best scale to extract relevant information correspond to the difference between 
so course signals in scale k=5 and 1=8 (A 25 f- A 2B f). This band frequency corresponding to 0.05-0.39 Hz was chosen for 
the DWT. 

[0027] Fig. 5(a) shows a typical sin(8) obtained from the integral of angular rate rotation during several SiSt and StSi 
transitions. This figure shows a typical problem due to integration drift, which is canceled after DWT (fig.5(b)). In ad- 
dition, superfluous peaks, which do not belong to transitions, can be observed in fig. 5(a). These peaks were caused 
55 by movement artifacts during transition. In fact in some case, especially in subjects who have difficulty to rising from 
a chair, an oscillatory movement is superimposed on the measured signal. Since PT detection is based on peak de- 
tection, the presence of these peaks can produce some errors in transition detection. As shown in fig. 5(b) these peaks 
were canceled by the DWT while the true transitions were significantly enhanced. 
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[0028] Fig. 6 compares for 6 postural transitions, a typical pattern of the displacement and sin(6) obtained with VI- 
con™ with sin(9) obtained from the gyroscope. 

[0029] These results show that the estimated transition durations correspond to the true transition period observed 
with Vicon™. There is a close agreement between the two systems. The coefficient of correlation between sin(6) 
5 estimated from the gyroscope and that obtained from vlcon™ system varies between 0.90 and 0.99 depending on the 
performed test. 

[0030] Table 3 shows for each subject the values of M_TD and A_TD through all of the activities and the corresponding 
fall risk score. Expectedly, the non-faller group (fall risk score 0-3) was younger (75.5 +/- 3.39 years) than the falter 
group (fall risk score 5-10, 79.8 +/- 8.98 years). 

10 



TABLE 3 

SUMMARY OF THE RESULTS PER SUBJECTS 

15 





Subject 


M_TD 

(sec) 


A_TD 
(sec) 


S_Trs 


Falling 
Risk Score 




1 


3.85 


1.343 


14 


10 


aller 


2 


4.97 


1.665 


5 


9 


3 


3.27 


1.018 


5 


8 


u_ 


4 


4.16 


1.262 


0 


5 




5 


3.17 


0.930 


0 


5 




6 


3.24 


0.593 


0 


0 


03 


7 


2.96 


0.576 


0 


0 




8 


2.92 


0.549 


0 


1 




9 


2.94 


0.729 


0 


1 


o 
Z 


10 


2.52 


0.371 


0 


3 




11 


3.14 


0.959 


0 


2 



[0031] Fig. 7 shows a special case where several PTs occurring one immediately after the other while subject trying 
to stand or sit. This event called "successive transition" shows how many times a subject tries to make a PT but he/ 
she unable to do it. The occurrence of "successive transition" is noted by S_Trs in the table 3. In fallers group, this 
35 parameter is increased with falling score while in non-fallers S_Trs is always null. T-test performed between fallers and 
non-fallers groups show a significant increase of M_TD (p<0.02) and A_TD (p<0.002). 

[0032] The above cited example has shown that, based on a simple model and an appropriate DWT, three parameters 
(i.e. M_TD, A_TD and S_Trs) for evaluating the falling risk have been provided. 

[0033] The comparison between the two groups of elderly subjects (i.e. fallers and non-fallers) shows that M_TD 

40 and A_TD in different PT (whatever the type of chair) are significant parameters for discriminating between these two 
groups. In addition the occurrence of "successive transitions" is a third parameter, which is correlated to the fall risk 
score. These parameters correspond to one or two attempts before succeeding in standing up from a seat. Theses 
attempts due to muscular weakness or joint stiffness are indicative of a higher risk of falls during a very simple daily 
life activity. It is important to note that both normal and "successive transitions" have been accurately classified (sen- 

45 sitivity more than 99%). 

[0034] The type of PT (i.e. SiSt or StSi) did not change significantly as regards TD, therefore seems to have no 
specific role in the evaluation of falling risk in our tests. Table 4 shows the values of TD corresponding to SiSt and StSi 
for fallers and non-fallers groups. Although M_TD and A_TD are significantly different for fallers and non-fallers groups, 
within each group these values do not change significantly (p>0.4) with the type of transition (StSi or SiSt). It is clear 

50 that, if the type of transition were important, an improvement of the method would be necessary in order to classify the 
type of the posture. This classification could be made for instance by adding a vertical accelerometer on body trunk. 
[0035] Although the results presented in this example concern short recordings involving a limited number of PT, it 
is important to note that the system can be used for a long term monitoring. The batteries lifetime and memory card 
allows monitoring up to 24 hours. If necessary, the datalogger can be recharged quickly and memory card replaced 

55 for a new recording. Contrary to stationary system such as video motion analysis or force-plate system, the proposed 
system allows measurement outside of the laboratory, in ambulatory and daily life conditions. The system does not 
hinder the subject since only one miniature sensor is used that can be attached everywhere on the trunk and the 
recorder is very light. The integration of the sensor and the recorder in a same module allows providing a system 
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especially adapted for ambulatory instrumentation and tele-alarm systems. 

[0036] By considering the values of the estimated parameters during each day and their change over repeated meas- 
urements, the device can be considered a promising tool in home health care of elderly by giving objective figures of 
mobility of old people either healthy or suffering from specific conditions. Additionally, this device can be considered 
as a tool for an objective assessment of the fall risk and its change in elderly subjects during rehabilitation programs. 



TABLE 4 



TEMPORAL POSTURAL TRANSITION PARAMETERS FOR FALLERS AND 
NON-FALLERS GROUPS 


Temporal parameters 


Faller 


non-Faller 


SiSt 


StSi 


SiSt 


StSi 


M_TD 
(sec) 


3.73 


3.93 


2.90 


2.95 


A_TD (sec) 


1.06 


1.05 


0.47 


0.54 



Example B : Physical activity monitoring 
20 METHODS 

A. Experimental setup 

[0037] 11 elderly-Community dwelling subjects (6 females, 5 males, age 79±6 years) carrying a kinematic sensor 
on the chest performed 6 tests involving various postural transitions and dynamic activities (table 5). Written informed 
consent was obtained from the subjects. During walking, some subjects have used a cane. The kinematic sensor was 
composed of one miniature piezoelectric gyroscope (Murata, ENV-05A, ±400 deg/sec) measuring trunk angular velocity 
(g s ) in the sagittal plane and one miniature accelerometer (ADXL02, ±2g), measuring vertical trunk acceleration (a v ). 
The gyroscope, the accelerometer and their conditioning electronic were packaged in a very small box and attached 
on the chest. Signals were digitized at 40 Hz sampling rate and recorded by a light portable data logger (Physilog, 
BioAGM, CH) carried on the waist. 

[0038] The results of each test were validated using 5 cameras and 4 retro reflective markers placed on the trunk 
(Vicon™, Oxford Metrics, UK). This optical system allows an accurate 3D capture of chest movement (Fig.8). Three 
additional tests were performed with elderly subjects carrying the system for one hour in hospital building and outside, 
while an observer noted the actual activity of each subject. 

B. Lying detection 

[0039] The recognition of the lying posture from sitting and standing was performed by considering the orientation 
of the accelerometer with respect to the direction of gravitational acceleration (vertical axis). In lying posture, the ac- 
celerometer measures almost zero g while in sitting and standing it shows around 1g. 



TABLE 5 



DIFFERENT TESTS PERFORMED BY EACH SUBJECT 


Test 


Type of Activity 


Type of Seat 


1 


Sit + Lying + Sit + Stand + walk 


Bed 

(Desired Height for each subject) 


2 


Sit to Stand + walking + Stand to Sit 


Upholster without armrest 
(Seat height: 48 cm) 


3 


Sit to Stand + Stand to Sit 


Armchair with armrest 
(Seat height: 46 cm) 


4 


Sit to Stand + Stand to Sit 


Wooden chair without armrest 
(Seat height: 46 cm) 
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TABLE 5 (continued) 



DIFFERENT TESTS PERFORMED BY EACH SUBJECT 


Test 


Type of Activity 


Type of Seat 


5 


Sit to Stand + Stand to Sit 


Upholster chair without armrest 
(Seat height: 48 cm) 


6 


Sit to Stand + Stand to Sit 


Wooden Chair with armrest 
(Seat height: 46 cm) 



C. Sitting and standing detection 



15 



20 



25 



30 



35 



40 



[0040] The main problem of posture discrimination concerns the separation of sitting and standing postures. Sitting 
occurs at the end of the stand to sit transition ('StSi') while standing occurs at the end of the sit to stand transition 
OSiSf). As a result, the identification of these two transitions is sufficient to recognize sitting and standing postures. 
The acceleration a v during SiSt (resp. StSi) transitions was described using a simple kinematic model. Fig.1 shows 
that during both SiSt and StSi transition, there is first a forward lean followed by a backward lean. This tilt looks like a 
half period of sinusoid function where the minimum corresponds to the time of postural transition: PT. In order to estimate 
this time, first 8 (the trunk angle in the sagittal plane) was calculated by integrating g s . Then the sin(9) was calculated 
and its minimum peak was considered as PT. The postural transition duration (TD) was calculated by estimating the 
interval time between the beginning of forward lean and the end of the backward lean. Fig.9 shows, the nature of the 
vertical displacement during SiSt (also StSi) and the corresponding accelerations obtained from second derivative of 
the displacement. SiSt generates an acceleration peak (positive) followed by a deceleration peak (negative) while the 
inverse occurs for the StSi. Therefore, the pattern of a^ during the TD can be used for SiSt and StSi estimation. 
[0041] The important aspect of trunk tilt and acceleration pattern of posture transition is that the information of interest 
is often a combination of features that are well localized temporally or spatially. This requires the use of analysis methods 
sufficiently versatile to handle events that can be at opposite extremes in terms of their time-frequency localization. In 
trunk angular velocity, there are several peaks, which are not related to the posture transitions and make difficult the 
detection of the true pattern of PT. Moreover, computing 6 from the integral of g s involves drift in the measured signal. 
In order to cancel the drift and to prevent other noises such as movement artifacts, which aren't related to posture 
transitions, Wavelet analysis based on Mallat algorithm was used. This algorithm is based on two dedicated filters H 
(co) (Low-pass filter) and G(to) (High-pass filter) has been presented in fig. 10. At each scale j, the signal is divided into 
low frequency component (approximation: A^) and high frequency component (detail: D^) and loses in resolution 
because of downsampling. At scale j, A^ represents the approximation of the original signal with a resolution of one 
sample for every 2) samples of the original signal. In our algorithm, since all of the samples in time domain are needed, 
instead of down sampling in time domain the frequency band is divided by 2 in each step j. This new tool differs from 
the traditional Fourier techniques by the way in which they localize the information in the time-frequency plane. In 
particular, it allows trading one type of resolution for the other, which makes them especially suitable for the analysis 
of nonstationary signals such as human motion signals. Moreover, this method allows using a suitable basic function 
(mother wavelet), which is more similar to the pattern of trunk tilt and acceleration during posture transition. The ap- 
proximation of g s between scales 5 and 8 (A 2 5 - A 2 8 ) was used for TD detection. The band frequency corresponds to 
0.06-0.45 Hz. The a v approximated signal between scales 5 and 6 (A 2 5 - A 2 6 ) was used for SiSt or StSi recognition 
(band frequency: 0.23-0.45 Hz). For each approximation, 'coiflet' mother wavelet with order 5 was used. 



45 



D. Walking detection 



50 



55 



[0042] In order to detect the walking state, a v was analyzed every 5 seconds. Wavelet decomposition was also used 
to enhance the walking pattern and to reduce noise and drift arising from other activity such as posture transitions, 
turning or motion during standing posture. The approximated wavelet signal, DWT(a v ), between scales 2 and 5 (A 2 2 - 
A 2 5 ) was considered. A Daubechies mother wavelet with order 4 was applied. The band frequency corresponds to 
0.45-3.60 Hz. For obtaining the pattern of walking, negative peaks beyond a fixed threshold were detected. Successive 
peaks agreeing a time difference of 0.25 to 2.25 s belong to walking step and were chosen as candidate peaks. We 
assumed that a true walking signature has at least 3 steps during each 5s interval. Then if more than three peaks were 
detected, these peaks were considering as walking steps. 
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E. Physical activity classification 

[0043] By using the above algorithms physical activity was classified. However in order to improve this classification 
and reduce the false detection the following rules were considered: 

5 

- If two contradictory states were detected (e.g. lying with walking or sitting with walking), preference was given first 
to lying then to walking and finally to StSi or SiSt transition. 

- Two successively SiSt (or StSi) detections were not considered as correct. 
Leaning backward during standing state was considered as inconsistent for elderly. 

10 

RESULTS 

[0044] Fig. 11 and 12 show the efficiency of the wavelet analysis for SiSt and StSi detection. As illustrated, the nearest 
peaks in DWT(a v ) in respect to the local minimum of sin(6) are correctly detected. Negative peak is followed by the 

*5 positive one during SiSt transition (fig.H.c) while the inverse occurs for StSi transition (fig.12.c). The similarity of data 
obtained from the kinematic sensor and the Vicon™ system was high (0.90<r<0.99) as shown in fig. 13. Among 287 
postural transitions performed by all of the subjects, a sensitivity of 99% was obtained for detection of postural transition. 
The sensitivity and the specificity for sitting and standing classification have been shown in table 6. During tests 1 and 
2, which involve walking and lying period, these parameters were more than 90%. In our tests all lying and getting-off 

20 from the bed periods were correctly classified. 

[0045] Fig. 14 shows the effectiveness of wavelet analysis for walking sequence enhancement. In this figure, all 
peaks belonging to walking steps detected by the reference system (Vicon™) are marked. It can be seen that the drift 
in a v signal is reduced in DWT(a v ) while the actual walking peaks have been enhanced, which let to a better peak 
detection. 

25 [0046] These advantages of wavelet transform allow preventing any calibration for each subject. The sensitivity for 
walking period detection was more than 95%. 

[0047] Fig.15 shows a typical physical activity classification obtained during one hour of recording for an elderly. In 
this test, there isn't any misclassification and the results correspond entirely to the observer notes. In two others tests 
performed during one hour with two other elderly, the sensitivity for detection of lying, SiSt, StSi and walking state were 
30 more than 90%. 

[0048] This example has shown the possibility to categorize body postures and walking state with help of only one 
miniature sensor causing no discomfort for the subject. All results were validated using a standard reference system 
in a gait laboratory. The results show also that wavelet transform is a powerful technique to detect postural transition 
and to analyze walking pattern. The walking detection has a high sensitivity even, when subjects use walking aids such 

35 as cane. In addition, no calibration is needed according to each subject. 

[0049] The results show that during the tests 3, 4, 5 and 6, which do not involve walking and lying, the sensitivity is 
lower than for the tests 1 and 2 where a period of walking or/and lying is included. This is essentially due to the correction 
made in PT from the walking and lying state detection. This confirm our assumption according to which in our classi- 
fication, the priority is given first to lying then to walking and finally to StSi or SiSt. Furthermore during daily life, lying 

40 posture and specially walking state are often present. 
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TABLE 6 

SENSITIVITY AND SPECIFICITY OF TRANSITION DETECTION 



E 
2 

GO 



1 

2 
3 
4 
5 
6 

Mean 



Q- 

o 



40 
65 
58 
52 
56 
56 
57 



Sensitivity 



100 
97 
100 
98 
100 
100 



CO 

co 



91 
83 
54 
54 
75 
71 



CO 
CO 



97 
83 
77 
89 
86 
86 



05 

c 



100 



100 



c 

I 



95 
97 



96 



Specificity 



CO 
CO 



97 
86 
80 
81 
80 
85 



CO 
CO 



94 
86 
54 
58 
77 
74 



[0050] This method offers a promising tool for long term and home care monitoring of daily physical activity. It may 
to better appreciating the quality of life of patients with disability by quantifying their degree of mobility. This system 
may also be used for assessment of risk of fall in elderly. 

30 Example C : Absolute Trunk tilt calculation. 

[0051] Estimation of forward trunk angle (tilt) can be useful for qualifying each activity. Finding of this parameter can 
be also useful for the correction of activity quality. For example having a correct angle can be important for facility of 
posture changing or having a successfully transition on the bed. Study about correlation of trunk tilt with lower member 
35 such as hip and leg is also useful for assessing the quality of body posture transition and could be considered as a 
falling risk parameter. 

The measured frontal acceleration can be expressed as: 



40 



af acc = a f cose + gsinG 



(1) 
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Where : 

af a cc- = Measured signal by frontal accelerometer. 
af= Inertial frontal acceleration 
g= Gravity acceleration. 

9= Absolute angle (tilt) of body trunk surface (Place of sensor attachment). 

[0052] For finding the absolute tilt, signal of accelerometer, which has been attached on body trunk surface in frontal 
direction, is analyzed. Measured signal by frontal accelerometer has two components consisting of frontal acceleration, 
which arise from inertial body movement and gxsin(9), which arise from gravity acceleration (equation 1). 
[0053] From equation 1 , it is clear that when a^O, the accelerometer signal is related to only absolute trunk tilt value 
(af a cc = gxsin(9), if a^O). In the other word with measuring the acceleration signal in frontal direction in the situation 
of zero inertial acceleration, calculation of the absolute tilt will be possible. Moreover it can be assumed that the period 
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where variance of af acc is lower than a dedicate threshold, a, is around zero (gxsin(8), has a zero variance since 6 
has around a constant value). Therefore the absolute tilt in case of no-movement (acceleration variance about zero) 
such as sitting, standing and lying in a rest state can be estimated by calculation of the sin(9) from frontal accelerometer. 
For estimation of absolute tilt value in other case (activity with high variance), gyroscope signal is used as follow: 



0=jGdt + 0(t o ) (2) 

'0 

Where : 

15 e= Body Trunk absolute angle. 

G= Angular rate measured by gyroscope. 
tQ= Initial time 

e(to)= Initial trunk tilt value in t=tQ. 

[0054] It is clear that if there is one value of absolute tilt in any time, the absolute trunk tilt can be calculated over 
the time from above equation too. For finding of this initial value the mentioned method for calculating of '9' by frontal 
accelerometer is used. Then with combination of an accelerometer and a gyroscope, which are placed on the body 
trunk and the above method, absolute trunk tilt can be estimated. Two sample of absolute trunk tilt estimation for two 
different activities have been shown in fig. 16 and 17.. af acc and trunk angular rate measured by gyroscope have been 
shown on fig.16 (a) and (b). Fig 16 (c) and (d) show the absolute trunk tilt and variance of af acc respectively, calculated 
by this method during sit-stand and stand-sit transition Fig. 17 shows the same parameters on fig.16 for lying, walking 
and getting up from the bed activities. 

[0055] In addition, by using a vertical accelerometer the value of inertial acceleration can be estimated as follow: 

30 

av acc - a v cosG+gcose (3) 



Where : 

av acc .= Measured signal by vertical accelerometer. 

[0056] Knowing the a v is useful for calculating of vertical velocity and displacement and knowing a, is useful for 
calculating of frontal velocity and displacement. 

[0057] It should be understood that this invention is not limited to the examples or embodiments herein disclosed 
but comprises all modified forms as come with in the scope of the following claims. 



Claims 

45 1. A body movement monitoring system comprising : 

a sensor to be attached to the trunk of a subject, 
processing means for deriving information from said sensor, 
display means for displaying said information to an operator, 

50 

characterized by the fact that said system includes means for determining the time of postural transition. 

2. A monitoring system according to claim 1 wherein the sensor comprises a miniature gyroscope. 

55 3. A monitoring system according to claim 1 or 2 wherein said system includes means to determine the duration of 
postural transition. 



11 



EP1 195 139 A1 



4. A monitoring system according to any previous claim comprising alarm means which are activated when the quality 
of postural transition is behind a threshold. 

5. A monitoring system according to any previous claim comprising furthermore a vertical accelerometer. 

5 

6. A monitoring system according to claim 5 comprising furthermore a forward accelerometer. 

7. Method for measuring the time of postural transition in using the device of any claim 1 to 6 wherein the trunk tilt 9 
is first calculated by integrating the angular rate signal measured by said sensor, sin 9 is then calculated, the 

to postural transition corresponding to the minimum peak of sin 9. 

8. Method according to claim 7 wherein the duration of postural transition is based on the duration between the 
maximum peaks of sin 9 which occur before and after the time of postural transition. 

15 9. Method for evaluating the falling risk in using the device of any claim 3 to 6 wherein said falling risk is determined 
by a combination of three parameters, namely the average and standard deviation of transition duration and the 
occurrence of abnormal successive transition. 

10. Method for monitoring physical activity, particularly the walking and running periods, in using the device of any 
20 claim 5 or 6 wherein the vertical accelerometer is used for measuring these activities. 
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Fig. 2 
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Fig. 14 



26 



EP1 195139 A1 









Q 




H 0- 




O) - 




c 












O) 



11 




I I 




3000 4000 
Time (s) 



Fig. 15 



27 



EP 1 195 139 A1 




Fig. 16 



28 



EP1 195139 A1 




Fig. 17 



29 



EP 1 195139 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP GO 81 0920 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



D,X 



Citation of document with indication, where appropriate, 
o f relevant passages 



KERR KM WHITE JA BARR DA MOLLAN RAB: 

"Analysis of the si t- stand-sit movement 

cycle in normal subjects" 

CLINICAL BIOMECHANICS, GB,BUTTERWORTH 

SCIENTIFIC LTD, GUILDFORD, 

vol. 12, no. 4, 1 June 1997 (1997-06-01), 

pages 236-245, XP004081337 

ISSN: 0268-0033 

* abstract; figures 1,2; tables 1-3 * 

* page 239, left-hand column * 



' US 5 919 149 A (ALLUM JOHN H) 
! 6 July 1999 (1999-07-06) 

* column 8, line 66 - column 9, line 59; 
figures 1-3 * 

EP O 849 715 A (GGT GES FUER 

GERONTOTECHNIK MB) 

24 June 1998 (1998-06-24) 

* column 2, line 38 - column 3, line 2 * 

* column 6, line 28-31; figure 1 * 

AMINIAN K ET AL: "PHYSICAL ACTIVITY 
MONITORING BASED ON ACCELEROMETRY: 
VALIDATION AND COMPARISON WITH VIDEO 
OBSERVATION" 

MEDICAL AND BIOLOGICAL ENGINEERING AND 
COMPUTING, GB, PETER PEREGRINUS LTD. 
STEVENAGE, 

vol. 37, no. 3, May 1999 (1999-05), pages 
304-308, XP000827335 
ISSN: 0140-0118 

* abstract; figures 1,3 * 

* par. 3 "Results", lines 1-8 * 



Relevant 
to claim 


CLASSIFICATION OF THE 
APPLICATION (tnt.CI.7) 


1,3,5,6 


A61B5/11 




A63B23/02 




G08B21/00 


2,4,7-lC 




2,4,7-lG 





-/-- 



The present search report has been drawn up tor all claims 



1,4 



TECHNICAL FIELOS 
SEARCHED (lnLCt.7) 



A61B 

A63B 
608B 
A61C 



?- 



Place oi search 

BERLIN 



Dale oi completion of the search 

5 March 2001 



Jonsson, P.O. 



8; 

li 



CATEGORY OF CITED DOCUMENTS 

X : panic ularly relevant it taken alone 

Y : particularly relevant it combined with another 

document of the same category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on. or 

after the tiling date 
D : document cited in the application 
L : document cited for other reasons 



& : member of the same patent famity. corresponding 
document 



30 



EP 1 195 139 A1 



s> 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 00 81 0920 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
_ of relevant passages 



GB 2 330 912 A (HAUPTVERBAND DER 
GEWERBLI CHEN) 5 May 1999 (1999-05-05) 

* abstract; figures 2,3,7,16 * 

* page 8, line 3-7 * 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (lntCI.7) 



The present search report has been drawn up for all claims 




Place of search 

BERLIN 



Date of completion of the search 

5 March 2001 



Jonsson, P.O. 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : non- written disclosure 
P : intermediate document 



T : theory or prtncple underlying the invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document cited in the application 
L : document cited for other reasons 

& : member of the same patent family, corresponding 
document 



31 



EP 1 195139 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 00 81 0920 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report 
The members are as contained in the European Patent Office EDP file on " 
The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 

05-03-2001 



Patent document 
cited in search report 



Publication 
date 



Patent family 
member(s) 





Publication I 




date 



US 5919149 
EP 0849715 
GB 2330912 



A 
A 
A 



06-07-1999 
24-06-1998 
05-05-1999 



NONE 

DE 19653773 C 



0E 
DE 
FR 
SE 
US 



29719250 U 
19849673 A 
2770391 A 
9803701 A 
6152890 A 



I 
I 
S 
2 

iu For more details about this annex : see Official Journal of the European Patenl Office, No. 1 2/82 



02-07-1998 



07-05-1998 

06- 05-1999 

07- 05-1999 
01-05-1999 
28-11-2000 



32 



